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(54) PICTURE ELEMENT DEFECT CORRECTION DEVICE 

(57)Abstract: 

PURPOSE: To obtain an excellent picture without r — 

deteriorating substantial picture quality by distinguishing ^fH«»M^I — 1 1**11**1- 

accurately a substantial signal from a signal resulting from a 
picture element defect, detecting and correcting the defect. 
CONSTITUTION: Picture element data yn-2, yn-1, yn+1, 
yn+2 for 5 picture elements in total being a noted picture 
element, its preceding and succeeding picture elements and 
their preceding and succeeding picture elements are extracted 
by flip-flop circuits 1-4, and adders 11-14 and comparator 
circuits 21-24 are used to apply arithmetic operation and 
discrimination to the picture element data. An AND circuit 30 
ANDs discrimination outputs from the comparator circuits 21- 
24, a picture element defect is discriminated when the four 
following equations are all satisfied, a detection circuit outputs 
a detection signal to allow a correction circuit 91 to provide a 
correction signal; yn-yn-l>al... (1), yn-2-yn-l<bl... (3), yn- 
yn+l>22... (2), and yn+2-yn+Kb2. 
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* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1]A pixel defect correction device comprising: 

A sampling circuit which samples a signal read from a solid state image pickup device. 
A value of an output of said sampling circuit to the 1st pixel. 
A value of the 2nd and 3rd adjoining pixel. 

An extracting circuit which extracts a value of the 4th and 5th pixel in a side which adjoined said 2nd 
and 3rd pixel and is separated from said 1st pixel, The 1st and 2nd arithmetic processing circuit 
[ respectively / constant value / search for a difference of a value of said 1st pixel and a value of said 2nd 
pixel, and a difference of a value of said 1st pixel, and a value of said 3rd pixel, and ], searching for a 
difference of a value of said 2nd pixel, and a value of said 4th pixel, and a difference of a value of said 
3rd pixel, and a value of said 5th pixel — respectively - constant value ~ or, The 3rd and 4th arithmetic 
processing circuit in comparison with a value which carried out data processing of said 1st, 2nd, and 3rd 
extracted pixel, an AND gate which takes a logical product of an output of said 1st, 2nd, 3rd, and 4th 
arithmetic processing circuits, and a correction circuit which amends an output of said sampling circuit 
with the output of said AND gate. 

[Claim 2] A pixel defect correction device comprising: 

Two or more solid state image pickup devices by which the ** value was carried out to a position from 
which half a pixel of the 2nd solid state image pickup device shifted to the 1st solid state image pickup 
device. 

A sampling circuit which carries out the sample of the signal read from said two or more solid state 
image pickup devices. 

A value of the 1st pixel of an output of said sampling circuit to said 1st solid state image pickup device. 
A value of the 2nd and 3rd pixel of said 1st solid state image pickup device that adjoins said 1st pixel, 
An extracting circuit which extracts a value of the 4th and 5th pixel of said 2nd solid state image pickup 
device in a side which adjoined said 2nd and 3rd pixel half a pixel, and is separated from said 1st pixel, 
The 1st and 2nd arithmetic processing circuit [ respectively / constant value / search for a difference of a 
value of said 1st pixel and a value of said 2nd pixel, and a difference of a value of said 1st pixel, and a 
value of said 3rd pixel, and ], searching for a difference of a value of said 2nd pixel, and a value of said 
4th pixel, and a difference of a value of said 3rd pixel, and a value of said 5th pixel - respectively - 
constant value — or, The 3rd and 4th arithmetic processing circuit in comparison with a value which 
carried out data processing of said 1st, 2nd, and 3rd extracted pixel, an AND gate which takes a logical 
product of an output of said 1st, 2nd, 3rd, and 4th arithmetic processing circuits, and a correction circuit 
which amends an output of said sampling circuit with the output of said AND gate. 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Industrial Application]In the imaging device which used solid state image pickup devices, such as 
CCD, this invention relates to the pixel defect correction device which detects and amends the picture 
element defect which exists in a solid state image pickup device. 
[0002] 

[Description of the Prior Art]In the solid state image pickup device generally formed with 
semiconductors, such as CCD, producing image quality deterioration according to the local crystal 
defect of a semiconductor, etc. is known. Since the image defect by which fixed bias voltage will always 
be added to the image pick-up output according to incident light quantity will appear as a high-intensity 
white point on a monitoring screen if this image defect signal is processed as it is, it is called white 
flaws. Since what has low photoelectric sensitivity appears as a black point, it is called the black crack (a 
picture element defect is henceforth called a crack). 

[0003]Conventionally, the detection to the above cracks is shown, for example in JP,61-261974,A. A 
noticed picture element is the method of detecting as a crack the pixel as for which more than a constant 
rate has a large or small output to a surrounding pixel, and this method takes the difference between 
adjacent pixels to a transverse direction and a lengthwise direction, and detects a pixel with a different 
output from a surrounding pixel. 

[0004]Hereafter, the case of detection of the white flaws in the horizontal direction of CCD shall be 
explained, and the conventional pixel defect correction device in this case is explained concretely first. 
[0005]To a surrounding pixel, 1 pixel of white flaws are accepted and usually project. For example, the 
relation between a noticed picture element and the pixel before and behind that is expressed like drawing 
8_(a). For this reason, a noticed picture element and a pixel before and after [ that ] adjoining are 
measured, and in more than a constant level, a noticed picture element can regard it as a crack, when 
larger than the pixel of order. 

[0006]The block diagram which realizes the above-mentioned contents is shown in drawing 7 . The 
inputted signal passes along two or more flip-flops (it abbreviates to FF below) 1 and 2, and obtains the 
noticed picture element value sent one by one, pixel value y j before and behind that, y n , and y n+1 . The 

adding machines 1 1 and 12, the comparison circuits 21 and 22, and AND circuit 30 are performing the 

following operation to these signals. 

[0007] 

y n -ryn >a i o> 
y n+ ry n >a 2( 2 ) 

aj and ^ ^ the thresholds of the projection amount to y n . lo f y , and y n+1 . 
Here, it thinks as aj^^a (>0). 
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[0008] When the value of the pixel to observe has projected to the value of the pixel of the circumference 
of it by the above in more than the constant level, it is regarded as a crack, and a detect output is 
outputted. A correction circuit is controlled by a detect output. 

[0009] About amendment of a picture element defect, some methods are shown in JP,62-8666,A. For 
example, there are the method of replacing by the pixel in front of 1 pixel or 2 pixels, the method of 
replacing by the average of the pixel value of order or a method of being perpendicular similarly, 
considering and replacing by the pixel on one, the method of replacing by the average of an up-and- 
down pixel value, etc. 

[0010]Here, a correction circuit shall be replaced by the average of the pixel value of order, a block 
diagram came to be shown in drawing 3 . and the operation is as follows. The inputted signal passes 
along FF7 and FF8 and extracts the value of a central noticed picture element, and the pixel value before 
and behind that. In quest of these average value, it is considered as the adjustment signal from the pixel 
value before and behind a noticed picture element. According to the detect output of a detector circuit, 
when the value of a central noticed picture element is judged to be a crack, an adjustment signal is 
usually outputted. 

[001 1] As mentioned above, to the pixel which more than the constant level has projected to the value of 
a surrounding pixel, it can detect as a crack, and it can amend so that it may not be conspicuous. 
[0012] 

[Problem(s) to be Solved by the Invention]However, according to the above-mentioned method, to a 
high frequency signal, in spite of being a signal, it may have projected with the signal phase and judges 
with a crack accidentally. 

[0013]For example, in the case of a CCD output signal like drawing 8 (b) t the signal of the center will 
be judged accidentally to be a crack, and will be incorrect-amended. It becomes a form where the signal 
which should exist essentially was missing like the correction circuit output signal of drawing 8 (b) by 
this. 

[0014]Thus, when there was a signal of high frequency, image quality was degraded, and it had the 
problem that a good picture could not be acquired. 
[0015]This invention solves such a conventional problem. 

Also in the picture which distinguishes a signal and a crack with sufficient accuracy with easy 
composition, amends only about a crack, and includes a high frequency signal, the purpose is to provide 
the pixel defect correction device which can acquire a good picture, without degrading original image 
quality. 

[0016] 

[Means for Solving the Problem]It is judged whether a signal projected further is in a flat part at the 
same time a pixel defect correction device of this invention detects a projected signal. 
[00 17] Since a crack serves as a 1 -pixel projecting signal like drawing 9 (a) when a crack is in a flat part, 
on a actual screen, a crack is dramatically conspicuous and amendment is needed in this case. 
[0018]On the other hand, since a crack does not serve as a 1 -pixel projecting signal like drawing 9 (b) 
when a crack is in a high frequency signal, on a actual screen, a crack is hardly conspicuous and does 
not need amendment in this case. 

[0019]For this reason, a pixel before and behind that is further judged that a pixel to observe is in a flat 
part if it is below constant value with that size as compared with a pixel which adjoins a noticed picture 
element, and a crack is detected. 

[0020]Even when a noticed picture element has projected in a continuous high frequency signal by the 
above, from there being nothing to a flat part, it is not judged as a crack but distinction of a crack and a 
high frequency signal is attained. 

[0021] A crack serves as a signal projected compared with the circumference although there was no 
crack in a flat part like drawing 9 (c) when large compared with a surrounding high frequency signal, 
and a crack is conspicuous on a actual screen. 

[0022]For this reason, measuring a pixel before and behind that with a pixel which adjoins a noticed 
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picture element further, that size detects a crack, only when small compared with a projection amount of 
a noticed picture element. 

[0023JA crack is large compared with a surrounding high frequency signal, by this, when conspicuous, 
it is judged as a crack, a crack is a projection amount comparable as a surrounding high frequency 
signal, and when it is hard to be conspicuous, it is not judged as a crack. 

[0024]Distinction of a crack and a high frequency signal is attained by the above, without spoiling 
power of a test of a crack. 

[0025]Also in a case where pixel ****** which carries out the ** value of the 2nd CCD to position 
shifted half a pixel is performed to the 1st CCD, When a value of a pixel of the 1st CCD (here for G 
signals) and a value (here for R signals) of a pixel of the 2nd CCD are arranged in a time series, 
Comparison of a pixel which left 1 pixel detects a projection amount of a crack from a noticed picture 
element and a noticed picture element, and comparison of a pixel which got used detects [ a pixel which 
separated 1 pixel from a noticed picture element, a pixel which adjoin it and which was left half a pixel, 
or 1 pixel ] further whether the crack is in a flat part. 

[0026]When pixel ****** is performed by the above, distinction of a crack and a high frequency signal 

is attained. 

[0027] 

[Function] According to this invention, a good picture can be acquired, without amending only about a 
crack and degrading original image quality, since erroneous detection and incorrect amendment are not 
performed like before in a high frequency signal, but a signal and a crack are distinguished and a crack 
can be detected with sufficient accuracy. 
[0028] 

[Example]Hereafter, the 1st example of this invention is described with reference to drawings. 
[0029]The block diagram of the 1st example of this invention is shown in drawing 1 . Incident light 
reaches CCD71 via a lens, and photoelectric conversion is carried out by CCD71, and it is changed into 
a digital signal via A/D converter 81. From this signal, a crack is detected in a detector circuit and a 
detecting signal is outputted. The correction circuit 91 is controlled by this detecting signal. 
[0030]In a detector circuit, it reaches a noticed picture element and before and after that by FF1-FF4 
first, and total [ of 5-pixel picture element data ] y n 2 before and behind that, y n V y n , y +1 , and y n+2 are 

extracted further. Here, the clock of FF1-FF4 is the same f CK as the clock of CCD71. The following 

operation is performed to these picture element data using the adding machines 11-14 and the 

comparison circuits 21-24. 

[0031] 

yn-y n -i >a i 0) 
yn-2-y n -i <b i (5) 

However, they are a 1 =a 2 =a (>0) and b 1 =b 2 =b. 

[0032]It judges fulfilling the conditions that the noticed picture element has projected to a peripheral 
pixel beyond in constant value by the formula (3) and (4). It has judged that this fulfills the necessary 
condition for being a crack, aj and a2 are the thresholds forjudging, and are setting for a projection 

amount to be beyond constant value to a^a^a (>0) here. These operations are performed using the 

adding machines 1 1 and 12 and the comparison circuits 21 and 22. 

[0033]It has judged fulfilling further the conditions that the difference of the pixel before and behind 
that is below constant value by the formula (5) and (6) to be a pixel which adjoins the pixel to observe. 
This performs only detection of the crack in a flat part, and distinction of a crack and a high frequency 
signal is performed, bj and b 2 are the thresholds forjudging display flatness, and are taken as bj=b 2 =b 

(<a) here. These operations are performed using the adding machines 13 and 14 and the comparison 
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circuits 23 and 24. 

[0034]It judges that AND circuit 30 takes AND of one bit output each by the four comparison circuits 
21-24, and fills all of the four above-mentioned formulas, when filling all of four formulas, it judges 
with a crack, and a detecting signal is outputted from a detector circuit, and an adjustment signal is 
outputted to the correction circuit 91 — it controls to carry out 
[0035] 

yn-i-yn-i^yn-i)^^ 7 ) 
y^-yn+i^n-yiH-i)^ w 

However, b 1 =b 2 =b = it is 1/2. 

[0036]The formula (5) and (6) is transposed to the conditional expression (7) and (8) that it is below the 
fixed multiple of the projection amount to the pixel which adjoins the pixel to observe, and the pixel 
which the pixel which the difference of the pixel before and behind that observes adjoins further. 
Thereby, even if the circumference of a noticed picture element is not flat, amendment becomes 
possible, when the projection amount of a crack is large enough compared with a surrounding high 
frequency signal and a crack is conspicuous. 

[0037]At this time, bj and b 2 are the coefficients for deciding the threshold showing the display flatness 

of a peripheral pixel to the projection amount of a noticed picture element, and are set to b 1 =b 2 =b=l/2 

here. The block diagram of the detector circuit in this case is shown in drawing 2 . The operation to a 
conditional expression (7) and (8) is performed using the adding machines 11-14 and the comparison 
circuits 23 and 24. 

[0038]The flume bypass composition which is below the value which lengthened constant value from 
the projection amount to the pixel which adjoins the pixel to observe, and the pixel which the pixel 
which the difference of the pixel before and behind that observes further adjoins is possible similarly. 
[0039]The block diagram of the correction circuit of the 1st example of this invention is shown in 
drawing 3 . The inputted signal passes along FF7 and FF8 and extracts the value of a central noticed 
picture element, and the pixel value before and behind that. Here, the clock of FF7 and FF8 is f CK . In 

quest of these average value, it is considered as the adjustment signal from the pixel value before and 
behind a noticed picture element. According to the detect output of a detector circuit, when the value of 
a central noticed picture element is judged to be a crack, an adjustment signal is usually outputted. Time 
doubling with a detector circuit shall be performed if needed. 

[0040]Hereafter, the 2nd example of this invention is described with reference to drawings. The block 
diagram of the 2nd example of this invention is shown in drawing 4 . Via a lens, it is separated into each 
chrominance signal of R, G, and B by prism, and incident light reaches CCD 72-74 corresponding to 
each. CCD 73 and 74 of R and B is arranged to CCD72 of G at the position which shifted half a pixel 
horizontally. Photoelectric conversion is carried out by these CCD 72-74, and it is changed into a digital 
signal via A/D converters 82-84. From this signal, a crack is detected in a detector circuit and a detecting 
signal is outputted. The correction circuit 92 is controlled by this detecting signal. 
[0041]Since R and B signal have the same relation to G signal, the case where G signal and R signal are 
inputted into a detector circuit has been shown here. G signal and R signal which were inputted into the 
detector circuit pass along FF51 and FF52 which operate by the same f CK as the clock of CCD, and are 

changed into the serial signal of G and R signal at a 2f CK rate by the selector which operates by 2f CK . 

Then, by FF1-FF6, if it is for example, G signal as a noticed picture element, a total of 5 pixels of G 
signal g^ around 1 pixel its g^j, g^, around 1.5 more pixels r n l 5 , and r n+1 5 will be extracted. Here, 

the clock of FF1-FF6 is 2f CK . The following operation is performed to these picture element data using 

the adding machines 1 1-14 and the comparison circuits 21-24. 
[0042] 

gn-gn-l >a l W 
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gn-gn + l >a 2 0°) 
r n + 1.5-8n + l <b 2 < 12 ) 

However, they are a^a^a (>0) and bj=b 2 =b. 

[0043]It judges fulfilling the conditions that the noticed picture element has projected to a peripheral 
pixel beyond in constant value by the formula (9) and (10). It has judged that this fulfills the necessary 
condition for being a crack. ^ and 2^ are the thresholds forjudging, and are setting for a projection 

amount to be beyond constant value to a^a^a (X)) here. These operations are performed using the 

adding machines 1 1 and 12 and the comparison circuits 21 and 22. 

[0044]It has judged fulfilling the conditions that the difference of a pixel before and behind that which 
left half a pixel is below constant value further by the formula (1 1) and (12) to be the pixel which 
separated 1 pixel from the noticed picture element. This performs only detection of the crack in a flat 
part, and distinction of a crack and a high frequency signal is performed, bj and b 2 are the thresholds for 

judging display flatness, and are taken as b 1 =b 2 =b (<a) here. These operations are performed using the 

adding machines 13 and 14 and the comparison circuits 23 and 24. 

[0045 ]It judges that AND circuit 30 takes AND of one bit output each by the four comparison circuits 
21-24, and fills all of the four above-mentioned formulas. When filling all of four formulas, it judges 
with a crack, and it controls to output a detecting signal and to output an adjustment signal to the 
correction circuit 92 from a detector circuit. 
[0046] 

^LS-gn-l^VSn-l)^^ 13 ) 

Ws-^+i^VW* 1 ^ 0 4 ) 

However, b 1 =b 2 =b = it is 1/2. 

[0047]The formula (1 1) and (12) is transposed to the conditional expression (13) and (14) that it is 
below the fixed multiple of the projection amount to the pixel which the pixel which separated 1 pixel 
from the pixel to observe, and 1 pixel of pixels which the difference of a pixel before and behind that 
which left half a pixel observes further left. At this time, bj and b 2 are the coefficients for deciding the 

threshold showing the display flatness of a peripheral pixel to the projection amount of a noticed picture 
element, and are set to bj=b 2 =b=l/2 here. The block diagram of the detector circuit in this case is shown 

in drawing 5 . The operation to a conditional expression (13) and (14) is performed using the adding 
machines 11-14 and the comparison circuits 23 and 24. 

[0048]The difference of the pixel which separated 1 pixel from the pixel to observe, and the pixel before 
and behind that left further half a pixel, The flume bypass composition which is below the value which 
lengthened constant value from the projection amount to the pixel which 1 pixel of pixels to observe left 
is possible similarly, and when the pixel which separated 1 pixel from the pixel to observe, and the 
difference of the pixel left 1 pixel before and behind that constitute a detector circuit, it is still still more 
possible similarly. 

[0049]The block diagram of the correction circuit of the 2nd example of this invention is shown in 
drawing 6 . The inputted signal passes along FF7-FF10, and extracts the value and the pixel value of 
around 1 pixel of a central noticed picture element. Here, the clock of FF7-FF10 is 2f CK . In quest of 

these average value, it is considered as the adjustment signal from the pixel value of around 1 pixel of 
the noticed picture element. An adjustment signal is outputted, when it judges with it not being a crack 
and the value of a central noticed picture element is judged according to the detect output of a detector 
circuit to be a crack. Time doubling with a detector circuit shall be performed if needed. 
[0050] Although only horizontally explained about the above example [ 1st and 2nd ], it is 
perpendicularly the same and the processing which combined both horizontal and a perpendicular 
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direction is also possible. 
[0051] 

[Effect of the Invention] A good picture can be acquired without amending only about a crack and 
degrading original image quality, since according to this invention erroneous detection and incorrect 
amendment are not performed like before in a high frequency signal, but a signal and a crack are 
distinguished and a crack can be detected with sufficient accuracy so that more clearly than the above 
explanation. 



[Translation done.] 
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DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing l] The block diagram showing the composition of the pixel defect correction device of the 1st 
example of this invention 

[Drawing 2] The block diagram showing the composition of the detector circuit of the pixel defect 
correction device of the 1st example 

[Drawing 3] The block diagram showing the composition of the correction circuit of the pixel defect 
correction device of the 1st example 

[Drawing 4] The block diagram showing the composition of the pixel defect correction device of the 2nd 
example of this invention 

[Drawing 5] The block diagram showing the composition of the detector circuit of the pixel defect 
correction device of the 2nd example 

[Drawing 6] The block diagram showing the composition of the correction circuit of the pixel defect 
correction device of the 2nd example 

[Drawing 7] The block diagram showing the composition of the detector circuit of the conventional pixel 
defect correction device 

[Drawing 8] The signal waveform diagram of the conventional pixel defect correction device 
[Drawing 9] The signal waveform diagram which it is going to solve by this invention 
[Description of Notations] 
1-6 Flip-flop 

61 The 1st arithmetic processing circuit 

62 The 2nd arithmetic processing circuit 

63 The 3rd arithmetic processing circuit 

64 The 4th arithmetic processing circuit 
71-74 Solid state image pickup device 
81-84 sampling circuit 



[Translation done.] 
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DRAWINGS 

[Drawing 1] 
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[Drawing 5] 
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[Drawing 7] 
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